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INTRODUCTION 

It is known that school culture or climate influences academic 
achievement, attendance, and student perceptions of cohesiveness 
and satisfaction (Fraser, 1986) . School climate is defined by 
Brookover et al. (1978) as "a school's academic norms, 
expectations and beliefs." They say, further, that this climate, 
although related to the social composition of the student body, is 
not synonymous with it. Anderson, in her excellent 1982 review of 
school climate literature, points out a number of other issues 
about school climate that researchers agree upon. First, they 
agree that such climate exists; second, that differences in the 
climates of various schools are complex and difficult to measure; 
third, that many types of student outcomes (not just cognitive ones 
but also affective behavior, values and personal growth) are 
affected by the school's climate; and fourth that understanding 
school climate will contribute to the understanding and prediction 
of student behavior. 

In most, recent years, the trend in school climate and 
environment studies has been in the direction of examining the 
perceptions of pupils and students, rather than the adults in the 
school. Measures of learning environment characteristics have 
emerged as important components of educational programs and 
curriculum evaluation efforts (Fraser, 1979,1981), theories of 
various learning environments (Moos, 1974,1976,1979), and 
comparisons of teachers' and students' perceptions of actual and 
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preferred learning environments (Fraser, 1982) . 

According to Walberg (1981, 1983, 1986), nine factors require 
optimization to increase affective, behavioral, and cognitive 
learning. Included in this model is an educationally stimulating 
psychological environment that includes classroom or school 
environment. Brookover et .al . (1978) found that school composition 
(i.e., SES and racial composition) does not necessarily determine 
school climate, and that changes in school composition variables 
without concomitant changes in school climate may not bring about 
desired changes in school level achievement. It is believed by 
Brookover that favorable climate is a necessary condition for high 
achievement. There is growing evidence that student perceptions of 
classroom process are valuable sources of information about schools 
(e.g., Cooper & Good, 1983; Peterson & Swing, 1982; Rohrkemper, 
1984; Weinstein, 1983); however, student data are most useful when 
combined with process observation and contextual information. 

The Louisiana School Effectiveness Study (LSES) was conceived 
as a multi-year, multi-phase examination of student, teacher and 
school-level behaviors/characteristics, their effects on 
achievement and other desired student outcomes. Altogether, there 
have been four phases to the LSES study: LSES-I, a pilot study 
conducted in 1981-82; LSES-II, a macro-level study of 76 elementary 
schools from throughout the state of Louisiana conducted in 1982- 
83; and LSES-III and -IV, a longitudinal micro-level study 
conducted in 16 schools in 1984-85 and again in 1989-90. During 
both LSES-III and LSES-IV, multiple measures of student outcome and 



attitude data were gathered on all third grade students in eight 
matched (SES, racial composition, district) pairs of elementary 
schools. 

This research was conducted to examine student's perceptions 
of their elementary school climate during two phases of the 
Louisiana School Effectiveness Study. The following questions 
guided the research: 1) What were the differences over a five year 
period of the students' perceptions of their school climate? 2) 
How did their perceptions relate to the classification of effective 
and ineffective schools over this time period? 

METHODS AND PROCEDURES 

Sample 

The sampling pool consisted of 13 school systems. Within 
systems, third-grade school means on the total reading section of 
the state basic skills test (BST) were obtained. Mean scores by 
school were computed for two consecutive years. The final sample 
consisted of eight pairs of schools - rural, urban and urban-to- 
suburban pairs representing all geographic regions of the state. 
Within these constraints, schools were selected that scored above 
(or below) achievement prediction both years, with one year being 
substantially above (or below) prediction. Purkey and Smith (1983) 
suggested that outlier studies should consist of schools that had 
been demonstrated to be consistently positive or negative outliers. 



Instrumentation/Measures 

The elementary students' perceptions of the school climate 
were measured by a 40 question version of the School Social 
Climate Study (Student Questionnaire)/ (Brookover, et al,1979). 
This questionnaire was administered in Phase III and Phase IV of 
the LSES to all third grade students in the 16 schools 
participating in the study. 

The data that served as the primary focus of this .study was 
derived from both high and low inference classroom observation 
instruments, the Classroom Observation Instrument (COI) / the 
Virgilio Teacher Behavior Inventory (VTBI)/ and the Classroom 
Snapshot (CS) from the Stallings Observation System (Stallings, 
and Kaskowitz, 1974, Stallings, 1980) }. The COI and the VTBI were 
used to gather high inference data on teacher behavior in LSES-III 
and -IV respectively, while the CS was used to gather low inference 
data. Researchers gathered extensive field notes that greatly 
enhanced the qualitative aspect of the study. This qualitative 
data collaborated in supporting the findings from the other data 
sources of the study. 

The LSES-III and -IV used the outlier approach (Purkey and 
Smith, 1983) to categorize schools as effective or ineffective. 
This approach typically involves the use of a mathematical model to 
predict school-level student achievement based on factors such as 
the socioeconomic status (SES) of the students' families. If the 
actual school-level achievement is significantly above expected 
achievement, the school is classified as effective, if it is below 
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expectation, the school is considered ineffective. In LSES-III, a 
prerequisite for inclusion as an effective or ineffective school 
was consistent superior or inferior performance over a two-year 
period. School effectiveness is defined in this study in terms of 
expected versus actual student achievement over a two-year period 
(Teddlie, Kirby, and Stringfield, 1989) . LSES-IV is a five year 
follow-up of the 16 schools in LSES-III. 

«• 

Data Collection Procedures 

Each school in the sample was visited by a two-person team for 
three full school days in the fall and the spring school year in 
LSES-III and -IV. In the spring of 1990, these visits were 
shortened to two days. Each observer on the team visited every 
third-grade class for at least one class period each day. No 
school in the study contained over four third-grade sections. The 
remaining time allocated for classroom instruction was used to 
observe randomly chosen non-third grade classes. In Phase IV the 
team visited beginning teachers before randomly selecting other 
classes. Observers were instructed to begin taking notes one 
minute after the designated academic time had begun and not to code 
behaviors during times between periods. 

School climate questionnaires were administered to the third 
grade classes in both effective and ineffective schools in the 
morning of the last day of the visit. The 40 item instrument for 
school climate assessment was a modified version of a questionnaire 
developed by Brookover and colleagues (1979). Brookover's 
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instrument used to measure school climate was developed in the 
mid-1970' s and was a methodological break-through. The instrument 
allowed researchers to assess school climate variables, which 
measure the social psychological climate for learning in the 
school. Before Brookover's work, these kinds of variables had not 
been included in studies of the educational production function 
(Hanushek, 1979) , which assesses the relationships of various 
educational inputs to student achievement. Brookover's original 
climate questionnaire was composed of the following student scales: 
1) student sense of academic futility, 2) future evaluations and 
expectations, 3) perceived present evaluations and expectations, 
4) perceptions of teacher push and teacher norms, and 5) student 
academic norms. The LSES-II student climate questionnaire was 
revised based on pilot testing from LSES-I (Teddlie, Falkowski & 
Falk, 1982) . Two types of questions measuring self-concept 
(Michael & Smith, 1976) and locus of control (Crandall, Katkovsky, 
& Crandall, 1965) were added to the student questionnaire. 

Data Analysis 

The questionnaire was analyzed by item mean score . The 
results were reported by school. Certain items were classified and 
analyzed by sub-groups (self-concept and locus of control), while 
others were analyzed as individual items. The analyses were 
computed for both LSES-III and LSES-IV, 

A comparison of the analvsis of the two phases of LSES over a 
five-year period of the sc j1 climate questionnaire was done. 
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This comparison was done using item and sub-group means for each of 
the eight pairs of effective and ineffective schools. 

An Analysis of Variance (AN OVA) was performed on the data 
using the classification of the schools (stable effective, 
improving, declining, and stable ineffective) and the socioeconomic 
status (SES- low, middle) of the schools were the independent 
variables and the questionnaire items and subgroups were the 
dependent variables. 

Discussion of Results 

In classifying the sixteen schools in LSES-I.TI, eight schools 
were determined to be effective and eight were determined to be 
ineffective. Over the five year period, five of the effective 
schools remained effective (stable effective) , while three of the 
LSES-III effective schools declined over the same period. 

Data on student perceptions of the school climate in the eight 
pairs of effective and ineffective schools were examined. The 16 
items selected from the student climate inventory analysis 
pertained to the students' perceptions of the school climate, not 
their perceptions of self or teacher. 

In historically ineffective schools, three of the schools 
remained ineffective over the five year period. The analysis of 
the student questionnaire supports this classification in how the 
students perceive their school climate. For example, the students 
perceived that more than half of the teachers did not care if the 
students received bad grades (See Table 1, item # 15) . This 
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perception was consistent over both phases of the study. An 
improvement in the classification from a historically ineffective 
school during Phase III to an improving ineffective school in Phase 
IV was substantiated by the perceptions of the students in the 
school. For example, students perceived that students learned 
about the same as students in other schools in Phase III, whereas 
in Phase IV, they felt that students learned a lot more in their 
school (Table 1, item # 11) . 

In historically effective schools, five of the schools 
remained effective over the five year period. This was supported 
by little change in how the students perceived the school climate. 
One of the historically effective schools showed a declining trend 
from Phase III to Phase IV. This decline was supported by the 
student perception questionnaire. For example, in Phase III the 
students perceived that some of the teachers did not care how hard 
the students worked as long as they passed. In Phase IV, most of 
the teachers cared how hard the students worked. These student 
perceptions supported the changes in the schools over the five-year 
period (Table 1, School 6213, # 18). 

Examining the results of the number of changes greater than 
0.5 by item classified by type of school (historically effective or 
historically ineffective) (Table 2) showed that students perceive 
more change in ineffective schools. Table 2 shows that students 
have a harder time seeing change in effective schools than they do 
in ineffective schools. There were more changes per item in the 
ineffective schools than in the effective schools. Students in the 
ineffective scnoois were perhaps more aware of chancres around them, 
whereas the students in the effective schools were more complacent 
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and perceived a stable status quo. 

The Analysis of Variance was based on the independent 
variables of SES and school classification over the five year 
period. The results of the ANOVA indicated complicated 
interactions. In Table 3 the students' perceptions supported the 
marginal means from the ANOVA on the schools that changed over the 
five year period. The main effect is shown when the categories 
of stable effective/improving and stable ineffective/declining are 
collapsed. This is particularly the case in declining low-SES 
schools and in improving mid-SES schools. It is best to focus on 
the schools in transition because students can see improvement in 
improving schools and decline in declining schools. It is harder 
for students to perceive stability in stable effective and 
ineffective schools . 

Discussion 

Although there have been fruitful attempts to measure general 
reactions of teachers and students to school (e.g. Brookover et 
al., 1979), future research needs to focus more closely on 
participants' reactions to specific events, especially events 
believed to be central to school effectiveness. 

It is also important to assess the influence of school culture 
and instructional processes on students' perceptions. It is one 
thing to say that students and teachers should hold high 
expectations, but another to get answers to specific questions. 
How do students know how hard they should work? How can students 
know whether they are devoting more or less effort to schoolwork 
than their peers? The work of Natriello and Dornbusch (1984) 
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illustrates the value of measuring student perceptions, as well as 
the difficulty of doing this work. 

Measurement of student's perceptions and observations of what 
they do in classes should be more central to the study of effective 
schools than it has in the past. Future studies of effective 
schooling could make better use of student interviews in order to 
understand how different types of students perceive and act upon 
the various constraints present in more or less effective schools. 

Good and Brophy (1986) believe that information about how 
students and teachers perceive instructional processes and 
opportunities in more effective schools is needed to provide clues 
about how to make schools more effective. Similar arguments could 
be made about the value of measuring teacher beliefs, perceptions, 
and decision-making skills related to effective schooling. There 
are important data to suggest that teachers' expectations for 
student performance vary from school to school (Brookover, et.al. 
1979); however, needed now are assessments of other teacher 
perceptions that may help explain why some teachers hold high 
expectations for student learning. 

In light of these suggestions for more extensive research in 
the area of student and teacher perceptions of their schools and 
learning environments, another aspect of learning environment 
research should be considered. Are students' perceptions of their 
learning environments more accurate than their teachers' 
perceptions? Comparisons of data collected in these two fields 
could reveal interesting results to the school effectiveness 
literature . 
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Table 1 



Student Perception of Change in School Climate, 
1984-85* and 1989-90 Cohorts 



School #1107 
LSES-III 
Ineffective 



#1107 
LSES-IV 
Stable 
Ineffective 



#2215 
LSES-III 
Ineffective 



#2215 
LSES-IV 
Improving 



Item 


#3 


4.4 


4.5 


4.6 


4.4 


#11 


1.4 


1.3 


1.8 


1.5 


#12 


1.9 


1.8 


2.5 


2.1 


#13 


1.6 


1.4 


1.9 


1.6 


#14 


2.5 


2.0* 


2.8 


2.4 


#15 


3.9 


4.2 


3.9 


4.3 


#16 


2.8 


2.0* 


2.8 


2.5 


#17 


1.3 


1.3 


1.7 


1.6 


#18 


3.2 


2.8 


2.9 


3.4* 


#19 


1.9 


1.2* 


1.8 


1.3* 


#21 


1.6 


1.7 


2.1 


1.9 


#22 


1.6 


1.9 


1.8 


2.0 


#23 


3.5 


3.5 


3.7 


3.8 


#25 


3.0 


3.6* 


4.0 


3.7 


#26 


3.5 


3.6 


3.7 


3.8 


#27 


4.1 


4.3 


3.8 


4.0 



School #1317 
LSES-III 
Ineffective 



#1317 
LSES-IV 
Improving 



#3103 
LSES-III 
Ineffective 



#3103 
LSES-IV 



Item 


#3 


4.3 


4.8* 


4.4 


4.7 


#11 


1.6 


1.5 


1.5 


1.5 


#12 


1.9 


2.2 


2.0 


1.8 


#13 


1.7 


1.4 


1.8 


1.6 


#14 


2.5 


2.3 


2.1 


2.2 


#15 


3.4 


4.5* 


3.8 


3.3* 


#16 


2.4 


2.9* 


2.5 


2.4 


#17 


1.4 


1.5 


1.8 


2.0 


#18 


3.7 


3.0* 


2.7 


2.9 


#19 


1.8 


1.6 


1.6 


1.7 


#21 


2.1 


2.2 


2.2 


1.9 


#22 


1.8 


1.8 


2.1 


2.0 


#23 


3.3 


4.0* 


3.0 


3.4 


#25 


3.4 


3.9* 


3.4 


3.3 


#26 


3.7 


3.7 


3.7 


3.1* 


#27 


4.1 


4.1 


4.4 


4.3 



* A change between the two years of greater than the absolute value 
of +. 0.5 scale points. 
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15 



School #4101 
LSES-III 
Ineffective 
Item 



#4101 
LSES-IV 
Improving 



#3 

#11 

#12 

#13 

#14 

#15 

#16 

#17 

#18 

#19 

#21 

#22 

#23 

#25 

#26 

#27 



0 
4 
.9 
.6 
.3 
.8 
. 1 
.5 
.2 



1.5 
2.2 



8 

.6 
.9 
.9 
.0 



4 
1 
1 
1 
1 
3 
2 
1 
2 
1 
1 
1 
3 
4 
3 
4 



5* 

3 

6 

.5 

,4* 

.5 

.1 

.5 

.7* 

.2 

.5* 

.5 

.0* 

.0 

.9 

.4 



#6116 
LSES-III 
Ineffective 



4.2 
1.8 



2. 
2. 
2 . 
4 . 
2. 
1 , 
3 , 

1 , 

2. 

1. 

3, 

3, 

3 

4 



2 
0 
5 
2 
8 
6 
0 
5 
9 
8 
9 
7 
1 
1 



#6116 
LSES-IV 
Improving 



4.6 
1.4 
1.9 



1 . 
2. 
4 , 
2, 
1 



7 

0* 
2 

3* 
2 



3.4 
1.3 



8* 

.9 
1 
9 



3.8* 
4.4 



School #5105 


#5105 


#7102 


#7102 




LSES-III 


LSES-IV 


LSES-III 


LSES-IV 




Ineffective 


Stable 


Ineffective 


Stable 






Ineffective 




Ineffective 


Item 










#3 


4.1 


4.5 


3.9 


4.7* 


#11 


1.4 


1.5 


1.8 


1.3* 


#12 


1.8 


1.8 


2.0 


1.9 


#13 


1.3 


1.6 


2.0 


1.7 


#14 


2.0 


1.8 


2.3 


2.1 


#15 


3.6 


3.4 


4.1 


3.9 


#16 


2.2 


2.1 


2.3 


2.7 


#17 


1.7 


1.6 


1.6 


1.9 


#18 


2.7 


2.9 


3.4 


4.0* 


#19 


1.3 


2.0* 


1.6 


1.7 


#21 


1.8 


2.0 


2.4 


2.1 


#22 


1.5 


1.9 


2.0 


2.1 


#23 


3.2 


2.8 


4.0 


3.4* 


#25 


3.6 


3.6 


3.7 


3.0* 


#26 


3.3 


3.3 


3.8 


3.5 


#27 


4.2 


4.2 


3.9 


4.1 



* A change between the two years of greater than the absolute value 
of + 0.5 scale points. 
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School #1210 #1210 
LSES-III LSES-IV 
Effective Stable 

Effective 
Item 



#2206 #2206 
LSES-III LSES-IV 
Effective Declining 



ft O 


4 ? 


A A 


4 . J 


4 . 6 


#11 
IT ± ± 


1 7 


1 A 


1 "7 


1 .4 


#12 


2 0 


1 

J- . O 


Z . Z 


1 . 9 


#13 


1.9 


1.8 


2.1 


1.7 


#14 


2 4 


9 4 


9 9 
Z . Z 


2.8* 


#15 


3.8 


3 9 


4 n 


9 o 
o . 0 


#16 


2.6 


2 ? 


9 4 
Z • H 


2 . 4 


#17 


1.6 


1 . 5 




1.7 


#18 


3.1 


? n 
o • u 




3 . 8 


#19 


1.5 


1.6 


1.4 


1.9* 


#21 


2.5 


1.8* 


2.3 


2.3 


#22 


2.0 


2.0 


1.6 


1.8 


#23 


3.6 


4.0 


4.0 


3.7 


#25 


3.4 


3.4 


3.9 


3.4* 


#26 


3.7 


3.5 


3.8 


3.5 


#27 


4.2 


4.3 


3.9 


4.1 


School #1409 


#1409 


#3211 


#3211 




LSES-III 


LSES-IV 


LSES-III 


LSES-IV 




Effective 
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* A change between the two years 
of _+ 0.5 scale points. 
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greater than the absolute value 
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* A change between the two years of greater than the absolute value 
of + 0.5 scale points. 
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Table 2 

Number of Changes 

Historically Historically 
Ineffective Schools Effective Schools 



Item Item 



# 3 
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# 3 


- 1 
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#13 


- 1 
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#15 


- 3 
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#16 


- 2 


#16 
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#18 


- 1 
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- 2 


#19 




3 


#23 


- 1 


#21 
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#22 




1 


#26 
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#27 


- 1 


#25 




6 






#26 




4 






#27 




1 







I 
i 

j 



9 

ERJC 



19 



Table 3 

Changes in Student's Perception of 
School Climate in Schools Varying by 
SES and Ef fetive Status 



EFFECTIVENESS 
STATUS 



Improving 



SES 3£&RGXKMi 
LOW MIDDLE JfESSS 



Stable Effective 5.5 -6-5 -.3- 



1.0 7.0 4.0 



Declining -6.0 -05 -2.75 

Stable Ineffective -6.7 6.0 2.7 

Note: Difference in LSES-III and LSES-IV 
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